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= Why 48 Volt? 
= Overall Data Center Efficiency Analysis 
٭‎ Open Rack V2.1 Design 
= A48VDC Power Shelf 
= Battery Backup Unit 
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Why 48 Volt DC? 


= OCP has traditionally supported 12 volt 
systems, with great Success, so why 
change to 48 volt? 


= Power Density 
= Efficiency, Rack and Site Level 
= Economy of Scale 
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Why 48 Volt DC - Power Density 


= As power densities increase, it becomes progressively more difficult to 
move the power to the payloads. A single 12 volt rack may require two 
or three 12 volt systems, each with its own bus bar, to avoid massive 
losses 


= Each of these systems takes space away from revenue-generating 
payloads 


= For the same wattage, increasing the voltage by 4X means reducing 
the current by 1/4X 


= Current is directly proportional to heat and power loss, as well as to the 
amount of copper necessary to carry it 


= Generally, above 15kW per rack, 12 volt systems become too 
inefficient to manage 
s 
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Why not 70 or 100 VDC? 
= There are two main reasons for standardizing on 48 VDC: 


1. ‘Low Voltage’ is a recognized class of power delivery and allows 
for reduced safety requirements. DC power is only ‘safe’ at low 


voltages. 

The limits vary, but are generally below 60 VDC: 
NEC limit: 49 VDC 
NFPA limit: 60 VDC 
OCP limit: 59.5 VDC 


2. Telco has used 48 VDC as the standard for decades, so there is 
a wealth of existing products and technologies supporting it. 
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But Telco is negative (-)48 VDC? 


Telco standard is 48 VDC, but the polarity is NEG on the 48 VDC, and‏ ٭ 
the RTN is the O(*) VDC reference (ground)‏ 


= Telco standardized on -48 VDC to reduce corrosion on the wires by 
moving the corrosion to the framework (ground). This is important when 
a large part of the Telco infrastructure is outside. 


= This is not a big issue in a Data Center, but a bigger issue is the total 
potential voltage: 


Consider a Data Center with both +12 VDC and -48 VDC power‏ ٭ 
supplies, there is a possibility of having more than 60 volt potential‏ 
between two terminals, violating the low voltage limits‏ 


= Openrack V2 allows for both +48 and -48 VDC (A.2.2), but +48VDC is 
easier to support in a mixed environment 


Ws 
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So where did 54.5 VDC come from? 


" The Telco 48 VDC standard is actually the nominal voltage, but 
systems typically run at 52.5 VDC, 54.5 VDC, etc. 


This is due to battery charging requirements, for example:‏ ٭ 


=  Alead acid cell produces from about 2.2 volts, down to 
1.75 volts at full discharge 


=  Astandard 12 volt battery has six cell, and a 48 volt system 
has four 12 volt batteries, so the voltage range from 
Charged to Discharged is about 53 VDC to 42 VDC 


= To fully charge the battery, a slightly high voltage is needed 
= 54.5 VDC (float voltage) 


= NOTE: Consider the low voltage issue: l 
from +12 VDC (actually 13.6) to -48 VDC (actually 54.5) creates UD 
a 68 VDC total potential voltage - < 
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So where did 54.5 VDC come from? (continued) 


= Many years ago, the Telco voltage level was actually 48 volts for 
the equipment, and a separate charging system handled the 
batteries, but this made the systems more complicated and less 
reliable. 


= Connecting the batteries directly to the DC bus solves this issue. 


=  Itis the simplest and most reliable method to provide backup 
power, but it does requires the whole common bus to follow the 
battery voltage range. 


Per OCP: 42V - 58 Vdc, output defaulted to ۷ 
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A8V versus 12V, major improvement in efficiency: 


Efficiency:12V Rack VS 48V Rack (AC to chip) 

The power efficiency (AC to chip) will decrease 

as the rack-level power goes up 

٠ 12V system efficiency can reach 80% below 15KW 

٠ 12V system efficiency drops faster above 15KW, only 64% 
© 36KW 

٠ 48۷ system efficiency stays above 89% for power above 
15KW 
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A8V versus 12V, major improvement in efficiency: 


Busbar Copper Cross-Sectional Area(mm2) vs. kW 


The 48V DC output cables much thinner than 3000 
12V in high power applications 2500 
٠ Cable size can be only 1/9 compared with 12V 2000 


* Less cost on cables 
* Easier to manufacture 


OCP and Huawei opinion: 250 mm2 
> 156۷۷۰۰ 12V OCP power architecture 2 


2 ای ما اش یق‎ da یت 26. 29212324 مق‎ .29 30 32 3335 E 
>15KW: 48V OCP power architecture 
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Overall Data Center Efficiency Analysis 


Main Goal - Power to the Chips! 


Utility Tower 


Lj 


Chip 


Do Something 
to the Power 


OPEN. FOR BUSINESS. 


OCP 48VDC Power System Design 


Overall Data Center Efficiency Analysis - Moving to 48 VDC alone does not fix everything: 


Traditional AC to DC Power Path 


loss 


loss 


26 loss loss loss loss. 
o ere e سس( صلی(‎ Pee Len Lol zn اسوال‎ es non 
4 个 (3.3v 1.8v etc) 
Generator || Batteries 
Only Replace 12V with 48V 
loss loss loss loss loss 
Utility Primary Lines UPS Secondary Secondary ما‎ AC to ۷ Payload Hsu 12V to — Chip 
Tower Transformer Panel Transformer Panel PDU Rectifier POLs 
个 个 (3.3v, 1.8v, etc) 
Generator || Batteries 
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Overall Data Center Efficiency Analysis - Moving to 48 VDC alone does not fix everything: 


Traditional AC to DC Power Path 


loss loss 


% loss loss loss loss 
Utility Primary Primary UPS Secondary Secondary Rack AC to 12V Payload Card 12V Chip 
Tower r* Transformer I^ Panel T Transformer Panel di PDU Rectifier to POLs Ime 


Optimized AC to DC Power Path 


Generator || Batteries 


26 loss loss 26 loss loss 
Utility Primary Primary جا‎ to 48V Payload Card 48V اج‎ Chip 
Tower Transformer Panel Rectifier Rack to POLs 
个 个 (3.3v, 1.8v, etc) 
Generator Batteries 
in Rack 


(3.3v, 1.8v, etc) 


= 10%++ potential energy savings 


= May create SCCR issues 
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48 VDC OCP Design - Open Rack V2.1 standard compliant 
Key design targets: 


<= Power Shelf 


Play well with OCP Open Rack V2.1 
Overall size, shelf latching, common 48 VDC bus bar 


v2‏ ہے 


Maximum power density - up to 36kW in an OCP rack 48V Rack 


Support both single (split) phase and balanced 3-phase AC 
208 to 277 VAC 


Include high density battery option in the rack - variable capacity 


Maintain power until generator kicks-in - around 2 minutes 


Allow for an optimized power architecture <= BBU Shelves 
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48 VDC OCP Design - Highest Efficiency Rectifier Module 


Current Model: Future Model: 
R4850S R4875X 
*Peak efficiency: 98.1% *Peak efficiency: 9896 
*Output power: 3000W *Output power: 4500W 
*Power density: 42 W/inch3 *Power density: 63 W/inch3 
*Temp range: -40 to 55 degC *Temp range: -40 to 55 degC 
*Size: 1*2.5U* 12 inch *Size: 1*2.5U*12 inch NU) 
*Volume production in Q1, 2015 *Release: Expected Q2, 2018 امہ‎ 
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OCP V2 bus bar 


48 VDC OCP Design - Power Shelf Design, 36kW Capacity connector 


= Max 36kW output: Shelf design supports 24kW and 36kW 
output in a 30U space using Huawei's 98.1% efficient ۷ 
rectifier modules. 
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b. Optional jumper 


For 3-phase operation 
48 VDC OCP Design - Single/3-phase operation / 


= 3-Phase operation: Shelf is designed with nine rectifier 
modules arranged in three sets of three each. Each set 
is connected to one of the phases. This provides a 
perfectly balanced load on the 3-phase feed. 


= The system is also flexible, allowing the shelf to be 
converted to single-phase operation by simply removing 
a jumper. 


For 240V/415V 3P4W, With A\B\C\N\PE 


W 
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48 VDC OCP Design - Single/3-phase operation 


POWER SHELF - 48VDC OUTPUT 5 2 
I RECTI — RE Ri 


MAIN 3-PHASE TRANSFORMER: 415 VAC aS 1 
| BUILDING AC INPUT 
| LOAD CENTER TERMINALS 
T FOR 4AWG RING 


Option for Single AC Cable‏ ده 

= UL/IEC 60309 Connector 
= 5 PIN: L1, L2, L3, N, GND 
= Current: 100A 


VAC | i 2‏ 230/240 
1 ------------ وص لات سام ن ا L-N(TYP) | 1 e‏ 


INTERNAL 
OPTIONAL BUS BARS 


و JUMPER BAR‏ ادا 
CONVERTS TO‏ 

3 PHASE Or 

v 4 
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48 VDC OCP Design - High SCCR environments 


SCCR rating: Unit can work in a high 100kA SCCR environment with Class J fuses feeding the power 

shelf. The coordination between the rectifiers' internal fuses and the external Class J fuses is ; 
addressed by adding intermediate Class CC fuses in the shelf. These fuses are provided for each BT 
rectifier module, and fit within the 3OU shelf envelop. 


Fuse bank - one for each rectifier module 
Spare fuse | 


! 


UE 


Current-limiting 
fuse 
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48 VDC OCP Design - High SCCR environments 


Class J fuses Class CC fuses Power rectifier internal fuse 
10۸921001۸ input 1.6KA@10KA input 25A, RMS 750A 
RMS Current of 5.2KA RMS Current of 0.7KA 


POWER SHELF - 48VDC OUTPI 
1 RECT1 


RECT3 — RECT4 RECTS RECT6 — RECT7 RECTS — RECTS 


OUT OUT ‘our | || four 


100KA ! PUT PUT ur || | 
here ] uc | 


PFC 


INPUT | 
TERMINALS | 
FOR 4AWG RING | 
TERMINAL | 


1 
BUILDING 
WIRING 


MAIN 3-PHASE TRANSFORMER: 415 VAR N vv ١ 


230/240 VAC | [e^ 


1 INTERNAL 
1 - OPTIONAL BUS BARS 
——— JUMPER BAR 
CONVERTS TO 
3 PHASE 
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48 VDC OCP Design - BBU Architecture 


Each 1 OU shelf is made up of 3 battery modules and one 
communication board 


g = 7.5kW BBU shelf with 
Output connector for Openrack V2 bus bar, blind-mate, 250 amp max three battery modules 


power. Allows the customer to add or remove battery shelves as 
needed, without shutting down the rack. 


Maximum backup power is 7.5KW per shelf, and the backup time is 
2mins@7.5KW 


Each Battery Module has its own BMS to manage charge/discharge, 
and battery temperatures. Max operating temperature is 60degC 


Each battery module has its own DC/DC converter. This allows the 
module’s output to be a fixed voltage, while the individual cell voltages 


change during charging/discharging. This provides a much more stable = 250 AMP 48 VDC Connector - Mates to 0 
w 


power output for the payloads OCP Openrack V2 vertical busbar 
HUAWEI 
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48 VDC OCP Design - BBU, Cell selection - Safety comparison: LFP to NMC (Tested by Sony) 


= Battery modules are based on lithium-iron-phosphate battery cells that provide the best balance of 
safety, density, temperature resistance, and cost. 


= Each Battery module is made up of 64 18650 LFP cells, connected in 4 parallel sets of 16 cells each 


Chemical 


Nail test 
formula 


Material Energy density Burn test 


NMC Li[Ni,Co,Mn]O2 


LFP LiFePO4 160Wh/kg 
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48 VDC OCP Design - BBU, Safety comparison: LFP to NMC (Tested by Sony) 


Safety test (Single Cell, Nail test) 


a] 
LFP | | Before test 


Penetration to the full charged cell. Nail | V 
It is a test that assumes the battery damage due to building 
collapse, etc.. 


Sony's LIB (LFP) 


NMC } Before test 


i - 


Penetration 
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48 VDC OCP Design - BBU, Safety comparison: LFP to NMC (Tested by Sony) 
Safety test (Single Cell, Burner test 


Test for the emergency situation such as heating by fire 
in the surrounding area 


30seconds 45 seconds 80 seconds 
Safety vent open Cell dose not move. 
prevent explosion 

یب 


40 seconds 
Cell flew 
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2.5kW 2mins discharge at 45°C 
48 VDC OCP Design - BBU thermal considerations 


65 


During discharge, the cells in the battery modules heat up 
dramatically 


四 
o 


an 
a 


Thermal analysis is important, but steady-state analysis does not 
work. Since discharge is limited to less than 2 minutes, analysis is 
a transient problem 


a 
e 


Temperature(°C) 
P 
e 


D 
° 


Cool-down 


wo 
a 


0 60 120 180 240 300 360 420 480 540 600 
Time (S) 


—Non ventilated 


= The highest temperature is 58.1°C (13.1°C temp rise) 
after 2mins @ 2.5kW discharge for sealed BBU Ws 
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48 VDC OCP Design - BBU thermal considerations 


= Analysis is also important for full system to ensure servers 
and other equipment are not affected 


= Results: 


[38.2 degC| 


P 36.4 degC) 
ماھت‎ 
5 


٠ Due to short heat-up duration, the heat is only 
starting to soak into the surroundings when the 
discharge ends 


٠ Due to the large mass of the rack and equipment, 
actual effect on equipment is minimal 
(about 1 degC) 
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48 VDC OCP Design - BBU Control 


BMS functions: 

٠ Cell failure alarm 

* Cell imbalance detect 

٠ SOC/SOH calculation 

٠ Charge/discharge control 

Protection: 

* Over temperature (several temperature sensors monitoring high 
heat locations to guarantee the cells operate safely) 

* Over Current 

* Over Voltage 

* Four stages isolate faults from the battery pack, the DC/DC 
converter and the bus bar - guarantee cell safety and payload 
reliability 


Sleep Mode: Bidirectional DC/DC converter is Shunt Down, BMS Power Off, 
Power consumption is about OW 

Disconnect Bidirectional DC/DC converter Shunt Down, BMS Online , 

Mode: Communication & Temperature Detection & Voltage 
Detection are operating, Power consumption € 3W 

Charge Mode: | BBU in Charge mode 

Standby Mode: |BBU in Discharge mode 

Standby Mode: | After charging the BBU, the BBU will enter Pre-Discharge 


mode; This mode 
prepares for discharge 
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48 VDC OCP Design - Full System Configuration 


One Power shelf 
1 System controller 
9 Rectifier modules 


One or more BBUs, each with 
1 Communication module 
3 Battery modules 


BBU communication module receives health 
info from its battery modules, communicates 
to system controller 


System controller gathers BBU and rectifier 
module info, communicates with remote 
management 


Both rectifier and BBU modules function 
independently and safely if loss of 
communications 


COM IN: 
Reserved RS485 


COM. OUT: 


Reserved 85485 | 


r 
LAN: FE, SNMP HH 


USB: Only for 
outputting IP 
address 


COM: CAN bus 


Remote 
management 
system 


FE port 
SNMP protocol 


-— CAN BUS: Huawei private protocol 
(daisy-chain to BBUs) 


0 
0 
0 
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